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L  Abstract 


TT.  Introduction 


We  investigated  the  feasibility  of  detecting  the  failure 
of  a  thrust  vector  control  nozzle,  like  those  proposed  on 
advanced  concepts  of  air-to-air  missiles  (Figure  1),  using 
a  modified  Multiple  Model  Adaptive  Estimation  (MMAE) 
algorithm  with  a  Neyman-Pearson  based  Hypothesis 
Testing  Algorithm  (NPHTA).  These  nozzles  are  currently 
being  researched  as  a  means  to  allow  stable  flight  control 
at  high  angles  of  attack.  It  is  likely  that  the  missile  would 
tumble  if  a  nozzle  failed  during  a  high  angle  of  attack 
maneuver,  which  could  produce  catastrophic  results  if  the 
nozzle  failure  occurred  as  the  missile  is  separating  from 
the  aircraft.  Our  goal  was  to  determine  if  the  NPHTA 
version  of  the  MMAE  could  detect  a  nozzle  failure  during 
the  separation  flyout  maneuver,  prior  to  any  high  angle  of 
attack  maneuvers.  The  specific  failure  modes  that  we 
examined  were  single  failures  of  a  nozzle  valve  that  was 
stuck  either  open  or  closed.  We  found  that  under  idea 
conditions  the  NPHTA  MMAE  could  detect  a  nozzle 
valve  failure  within  one  clock  cycle  (0.02  seconds)  during 
this  initial  separation  flyout  and  thus  could  test  the  nozzle 
valves  prior  to  high  angle  of  attack  maneuvers. 


The  modified  MMAE,  diagrammatically  shown  in 
Figure  2,  uses  a  Kalman  filter  to  produce  a  residual  (the 
difference  between  the  filter  estimate  of  the  measurements 
and  the  actual  measurements)  which  the  NPHTA  tests, 
using  several  different  models  of  the  various  failure 
hypotheses,  to  determine  the  hypothesis  that  most  closely 
matches  the  true  failure  state.  Previous  research  [1,  2,  3] 
has  shown  that  the  NPHTA  requires  only  a  single  Kalman 
filter  residual,  provides  a  systematic  methodology  for  the 
MMAE  designer  to  obtain  the  desired  failure  detection 
performance,  often  detects  failures  faster  than  the  standard 
MMAE,  and  is  not  subject  to  variations  in  failure 
detection  performance  due  to  failure  injection  timing.  For 
this  application  we  modeled  a  valve  that  is  stuck  closed  as 
differences  between  the  control  input  matrices  (yielding 
hypotheses  in  terms  of  AB),  and  modeled  a  valve  that  is 
stuck  open  as  differences  in  the  control  input  vectors 
(yielding  hypotheses  in  terms  of  A«(t,) ).  These  known 
differences  are  used  to  compute  the  probability 
distribution  of  a  Kalman  filter  residual  for  each  of  the 
hypotheses,  which  are  then  used,  along  with  the  desired 
probability  of  detection  (Pd)  and  probability  of  false  alarm 
(Ppa),  to  conduct  a  series  of  binary  hypothesis  tests  (one 
hypothesis  versus  another  single  hypothesis)  to  determine 


Figure  2.  Multiple  Model  Adaptive  Estimation  Algorithm  using  the 
Neyman-Pearson  Hypothesis  Testing  Algorithm 
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the  most  likely  hypothesis.  Initial  results  indicate  that 
the  NPHTA  MMAE  detects  these  nozzle  failures  within 
0.02  seconds  after  the  failure  is  injected. 

III.  Theory  Development 

3.1  Truth  Model  Development 

We  started  our  investigation  by  developing  a  model, 
subsequently  called  the  truth  model,  that  gives  us  the  best 
estimates  of  the  missle  dynamics  under  the  various 
hypothesized  nozzle  failures.  We  started  with  an  existing 
linearized  model  of  the  form: 

XriO  =  (1) 

where  is  the  truth  model  state  vector 

is  the  truth  model  state  transition  matrix 
Bj,  is  the  truth  model  control  input  matrix 
Uj.  is  the  truth  model  system  input  vector. 

Initially  the  truth  model  consisted  of  nine  states 
(forward  velocity,  angle  of  attack,  pitch  rate,  pitch  angle, 
sideslip  angle,  roll  rate,  roll  angle,  yaw  rate,  and  yaw 
angle)  and  three  inputs  (pseudo-elevator,  pseudo-aileron, 
and  pseudo-rudder).  Given  the  initial  rocket  chamber 
pressure  and  the  thrust  vector  nozzle  throat  size,  we 
computed  the  force  that  could  be  applied  to  the  missle  by 
the  thrust  vector  nozzles  during  the  initial  separation 
flyout,  and  then,  given  the  distance  from  the  missle  center 
of  gravity  and  the  nozzle  throat,  we  computed  the  moment 
induced  by  the  thrust  vector  nozzles.  The  angular  rates 
due  to  these  moments  were  computed  using  the  given  roll, 
pitch,  and  yaw  angular  momenta.  The  model  in  Eq  (1) 
was  augmented  by  adding  the  induced  angular  rates  of  the 
thrust  vector  nozzles,  thus  giving  us  a  nine  input  model 
where  the  thrust  vector  nozzle  inputs  are  either  a  one  (for 
when  the  nozzle  is  fired  and  induces  the  additional 
angular  rate)  or  zero  (^or  when  the  nozzle  is  off). 

The  model  in  Eq  (1)  was  further  modified  to  include 
wind  gusts  (usine  the  Dryden  wind  gust  model  for 
moderate  chop  at  medium  altitude)  and  to  model  the  noise 
corrupted  measurements  that  would  be  available  to  the 
MMAE.  We  assumed  that  an  inexpensive  rate  gyro  is 
used  to  measure  the  missle  angular  rates.  Therefore,  we 
developed  a  linearized  model  of  the  form: 

X^(t)  = 

whereGy.  is  the  truth  model  noise  input  matrix 

Wj-  is  an  additive  white  Gaussian  discrete- time 
dynamics  noise  input  used  in  the  truth  model, 
with  zero  mean  and 


Zr  is  the  truth  model  measurement  vector 
Hj  is  the  truth  model  output  matrix 


Vj  is  an  additive  white  Gaussian  measurement  noise 
input  that  is  used  in  the  truth  model,  assumed 
to  be  independent  of  and  zero-mean  with 


We  chose  to  simulate  the  TVC  nozzle  failure  modes 
using  the  system  input  vector,  u.  The  nominal  system 
input  is  shown  in  the  first  column  of  Figure  3,  which 
shows  that  all  of  the  nozzles  are  pulsed  for  0.06  seconds 
starting  0.1  seconds  into  the  simulation.  If  there  are  no 
nozzle  failures,  the  net  result  of  this  input  is  to  cancel  the 
effects  of  each  individual  nozzle  on  the  missle  dynamics. 
We  simulated  a  TVC  nozzle  stuck  in  the  closed  position 
by  setting  the  corresponding  element  of  the  system  input 
vector  to  zero,  which  means  the  TVC  nozzle  is  closed, 
throughout  the  simulation.  A  failure  of  this  type  for. 
nozzle  1  is  shown  in  the  second  column  of  Figure  3.  We 
assume  that  the  most  likely  time  that  a  TVC  valve  would 
stick  open  is  at  the  tail  end  of  the  nominally  commanded 
pulse  input.  Therefore  we  simulated  a  TVC  nozzle  stuck 
in  the  open  position  by  setting  the  corresponding  element 
of  the  system  input  vector  to  one,  which  means  the  TVC 
nozzle  is  open,  after  the  initial  pulse  is  commanded.  This 
type  of  failure  for  nozzle  1  is  shown  in  the  third  column  of 
Figure  3. 


Input  lor  no  failure  Input  for  nozzle  1  oil  Input  for  nozzle  1  on 
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Figure  3.  System  Inputs  for  various  failure  models. 


Classical  MMAE  algorithms  have  used  a  bank  of 
Kalman  filters,  each  based  on  a  different  failure  model,  to 
generate  a  series  of  residuals  that  are  used  by  a  single 
Bayesian  hypothesis  testing  algorithm.  Previous  research 
[1,  2,  3]  has  shown  that  the  Kalman  filter  residuals  within 
a  classical  MMAE  structure  in  which  hypotheses  differ  in 
the  By  Hy  and  $  matrices,  are  normally  distributed 
random  vectors  with  the  same  known  (and  precomputable) 
steady  state  covariances,  but  different  means.  The 


2 

American  Institute  of  Aeronautics  and  Astronautics 


residual  covariances  are  the  same  because  the  Gaussian 
noise  inputs,  and  Vy>  are  not  a  function  of  and  O 
matrices  which  means  that  they  are  assumed  to  be  the 
same  for  each  of  the  hypotheses.  This  development  can 
easily  be  extended  to  include  hypotheses  that  differ  in  the 
system  input  vector.  Therefore,  the  Kalman  filter 
residuals  will  have  Gaussian  distributions  that  differ  only 
in  the  mean,  and  are  dependent  on  the  hypotheses  of  the 
Kalman  filter  internal  models. 

3.2  Kalman  Filter  Equations 

We  assume  a  time  invariant  Kalman  filter  model  with 
stationary  noises  (and  eventually  a  steady  state  constant- 
gain  Kalman  filter  for  implementation)  associated  with  a 
particular  hypothesized  failure  status,  which  will  be 
denoted  with  the  subscript  k.  Thus  we  have: 

where  is  the  Kalman  filter  model  state  vector 

is  the  Kalman  filter  model  state  transition 
matrix 

is  the  Kalman  filter  model  control  input  matrix 
is  the  Kalman  filter  model  system  input  vector 
G*  is  the  Kalman  filter  model  noise  input  matrix 
is  an  additive  white  Gaussian  discrete-time 
dynamics  noise  input  used  in  the  Kalman  filter 
model,  with  zero  mean  and 


z*  is  the  Kalman  filter  model  measurement  vector 
is  the  Kalman  filter  model  output  matrix 
Vjfc  is  an  additive  white  Gaussian  measurement  noise 
input  that  is  used  in  the  Kalman  filter  m<^del, 
assumed  to  be  independent  of  and  zero- 
mean  with 

=  (7) 

The  Kalman  filter  algorithm  uses  the  design 

model  to  define  time  propagation  and  measurement 
update  equations  of  the  state  estimates  and  the  state 
estimate  covariance  matrix.  The  state  estimate 

propagation  equation  based  on  the  Kalman  filter  model 
is: 

where  is  the  Kalman  filter  state  estimate  vector 

is  the  Kalman  filter  estimate  of  the 
measurement  vector  before  it  becomes 

available 

t-  is  the  time  just  before  the  measurement  update 
at  the  fth  time  sample,  and 


t.  is  the  time  just  after  the  measurement  update 
at  the  (i  - 1)  time  sample. 

Also,  the  state  estimate  covariance  matrix  propagation 
equation  is: 

The  state  estimates  are  updated  using: 

where  the  Kalman  filter  gain  is: 

and  the  filter-computed  residual  covariance  matrix  is: 

.R,.  (12) 

The  filter  residual  vector,  shown  in  Eq  (10),  is  defined  as: 

r»(0  &  z{tyH,£,(t;)  = 

which  is  simply  the  difference  between  the  measurements 
{z)  and  the  Kalman  filter  estimates,  based  on  its  model,  of 
those  measurements  before  they  are  taken 
Finally,  the  filter  state  estimate  covariance  matrix  is 
updated  using: 

The  steady  state  Kalman  filter  can  be  precomputed  by 
iterating  Eqs  (9),  (1 1),  (12),  and  (14)  until  steady  state  is 
reached.  With  this  steady  state  implementation,  the  state 
covariance  matrix,  the  steady  state  Kalman  filter  gain,  and 
the  steady  state  Kalman  filter  residual  covariance  matrices 
are  assumed  to  be  constant  and  therefore  do  not  need  to  be 
computed  in  real  time.  The  steady  state  Kalman  filter 
equations  become: 

for  propagating  the  state  estimates  and 


(9) 

(10) 

(11) 


m)  -  r,(0 

for  updating  the  state  estimates. 


(16) 


3.3  Nevman-Pearson  Based  Hypothesis  Testing 

Previous  research  [1,  2,  3]  has  developed  a 
methodology  to  compute  the  mean  and  covariance  of  the 
Kalman  filter  residual  given  that  the  Kalman  filter  model 
differs  from  the  true  in  the  state  transition  matrix,  control 
input  matrix,  and  output  matrix.  The  various  hypotheses 
that  were  explored  for  this  research  are  defined  by 
where 

AB,  A  -  B,  - 

We  denote  a  set  of  these  parameters  as  0  and  the 
parameter  space  of  all  possible  parameter  variations  as  ©. 
A  particular  hypothesis  is  constructed  by  defining  a 
subset  of  the  parameter  space: 

/i,:8e0,  .  (18) 

We  also  assume  that  the  various  hypotheses  form  a 
disjoint  covering  of  the  parameter  space,  so  that 

e  .  00  U  Oj  U  ...  U  0^.,  (19) 
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If  we  test  hf,  versus  h,  versus  ...  then  we  have  a  N-ary 
hypothesis  test.  The  primary  hypothesis,  which  is  the 
assumed  true  hypothesis  at  the  time  of  the  test,  will  be 
denoted  Hq.  The  other  hypotheses  will  be  called  the 
alternate  hypotheses.  Thus,  a  binary  hypothesis  test  is  a 
test  of  the  primary  hypothesis,  Hq,  versus  the  alternative 
hypothesis,  hy  N-ary  hypothesis  testing  is  an  extension  of 
binary  hypothesis  testing  by  simply  making  N-1  binary 
hypothesis  tests  between  the  primary  hypothesis,  /i^,  and 
the  N-1  alternate  hypotheses,  hj  through  to  obtain  the 
desired  N-ary  hypothesis  test.  This  is  sufficient  because 
the  covering  in  Eq  (19)  is  assumed  to  be  disjoint.  If  each 
subspace  contains  a  single  element  (i.e.  represents  a 
single  flight  control  failure  status),  then  the  hypothesis 
is  called  a  simple  hypothesis.  We  will  assume  that  the 
hypotheses  we  are  researching  are  simple  hypotheses 
(each  subspace  contains  only  a  single  TVC  nozzle  failure 
status  hypothesis). 


Figure  4.  Neyman-Pearson  Hypothesis  Test. 


The  basic  concept  behind  the  Neyman-Pearson 
Hypothesis  test  is  graphically  represented  in  Figure  4.  We 
start  by  assuming  the  one  hypothesis,  called  the  primary 
hypothesis  denoted  as  hypothesis  zero  is  Figure  4,  is 
currently  correct.  With  this  hypothesis  (hypothesis  zero) 
the  Kalman  filter  residual  would  have  the  distribution 
(assumed  Gaussian)  shown  on  the  left  of  Figure  4,  i.e. 
with  a  mean  of  mean^.  Under  another  possible  hypothesis, 
calledd  the  alternate  hypothesis  and  denoted  hypothesis 
one  in  Figure  4,  the  residual  has  a  different  distribution 
which  is  shown  on  the  right  of  Figure  4,  i.e.  same 
covariance  but  with  a  mean  of  meanj.  Given  the  desired 
probability  of  false  alarm,  we  can  compute  a  threshold,  P. 
If  the  sample  of  the  residual  is  above  P,  then  we  would 
conclude  that  hypothesis  one  is  most  likely  correct. 


Likewise,  if  the  sample  was  below  P  we  would  conclude 
that  hypothesis  zero  was  most  likely  correct. 

There  are  two  types  of  errors  that  can  occur  when 
testing  hypotheses.  Type  I  errors,  called  false  alarms, 
occur  when  the  alternate  hypothesis  is  chosen  when  the 
true  hypothesis  is  the  primary  hypothesis.  The  probability 
that  this  type  of  error  can  occur  is  called  either  the 
probability  of  false  alarm,  denoted  Pp^,  or  the  size  of  the 
test,  denoted  a .  Type  II  errors,  called  missed  detection, 
occur  when  the  primary  hypothesis  is  chosen  when  the 
true  hypothesis  is  the  alternate  hypothesis.  The 
probability  that  this  type  of  error  can  occur  is  called  the 
probability  of  a  miss.  This  probability  is  l-Pp,  where  P^ 
is  the  probability  of  detection,  also  called  the  power  of  the 
test. 


Note  that,  these  definitions  for  a  false  alarm  and  a 
missed  detection  are  used  for  Neyman-Pearson  hypothesis 
testing  [4].  Researchers  in  the  failure  identification  field 
usually  define  a  false  alarm  as  a  declaration  of  a  failure, 
when  in  fact  one  had  not  occurred,  and  a  missed  detection 
as  a  declaration  of  no-failure,  when  in  fact  a  failure  had 
occurred.  These  definitions  agree  with  the  Neyman- 
Pearson  definitions  above,  if  the  current  hypothesis  is  the 
no-failure  hypothesis.  Disagreement  occurs  when  a 
failure  hypothesis  is  in  force.  For  example,  if  the  assumed 
primary  hypothesis  is  a  failed  elevator,  and  the  hypothesis 
test  declares  a  no-failure  when  in  fact  the  elevator  failure 
remains  true,  the  Neyman-Pearson  definition  would  define 
this  a  false  alarm  but  the  usual  terminology  would  define 
this  as  a  missed  detection.  We  choose  to  use  the  Neyman- 
Pearson  definitions  because  they  are  defined,  without 
ambiguity,  by  the  design  parameters  PpA  and  the  P^ 

A  binary  test,  like  the  one  just  described,  of  hf,:  0  6  ©q 
(the  parameter  set  is  in  the  parameter  subspace  ©q)  versus 
/z^:  0  8  ©1  of  a  residual  would  take  the  form 
r  ,  / 1  ~  /i  r  e  R 

=  \o  -  V  re  A.  (20) 

This  is  read  [4]  "the  test  function  ^(r)  equals  1,  and 
hypothesis  hj  is  accepted,  if  the  residual  lies  in  the 
rejection  region  R.  The  test  function  equals  zero,  and 
hypothesis  is  accepted,  if  the  residual  lies  in  the  /i^ 
acceptance  region  A." 

The  Neyman-Pearson  Lemma  [4: 107]  tells  us  that  the 
test  of  the  form 


1, 


(|,{r}  = 


C, 

0, 


^//e,(0>r4(r) 
///e,(r)  =  r4(r) 
(f^(r)<r4(r) 


(21) 


for  some  test  threshold  F  >  0  and  some  0  ^  C  ^  U  is  the 
most  powerful  test  (the  test  with  the  largest  Pp)  of  size 
a  >  0  (for  a  given  Pfa)  for  testing  h^:  0  =  0o  versus 
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/zj:  0  =  01.  This  test  can  be  rewritten  by  defining  the 
likelihood  ratio  as: 


iir) 


/b.(0 


(22) 


SO  that  the  most  powerful  test  of  size  a  for  testing 

ho.  0  =  00  versus  hj:  0  =  0i  is  a  likelihood  ratio  test  of  the 

form 

fl,  ifl{r)>T 


(23) 


4>{r}  =  iC,  ifl{r)-V 
[0,  ifl{r)<V 
If  /  (r)  =  r  with  probability  zero,  then  C  =  O  and  the 
threshold  F,  for  a  given  size  (Pf^)  and  power  (Pd),  can  be 
computed  from: 


r  r 

where  L  (  /  )  is  the  density  function  of  /  (r)  under  ho. 


3.4  Single  Residual  Equivalence 

We  will  now  show  that  the  likelihood  ratio  in  Eq  (22), 
which  operates  on  a  single  residual,  is  equivalent  to  a 
likelihood  ratio  that  operates  on  two  different  residuals. 
This  will  allow  us  to  use  the  structure  in  Figure  1,  where 
a  single  Kalman  filter  residual  is  used  with  multiple 
hypothesis  tests,  in  place  of  the  classical  MMAE 
structure.  First,  we  assume  that  the  density  functions  used 
in  the  likelihood  ratio  are  conditioned  on  the  measurement 
history  Z(r,.i).  We  will  compare  two  residuals  from  any 
two  different  Kalman  filters,  and  generated  at  time  f,. 
The  Kalman  filter  models  used  in  these  filters  use  two 
different  hypotheses  that  differ  from  the  true  system 
model  only  in  the  control  input  matrix,  allowing  us  to 
describe  these  residuals  in  terms  of  and  We 
compare  the  two  likelihood  ratios  to  check  for  equality 
and  for  simplicity  of  notation,  we  are  suppressing  the  time 
argument,  of  the  residuals: 


/e/r.)  ^ 


P,  exp  { 

Po  exp  j  - 
7  P,  exp  1 

\  -  ^Z(l,.,)  }  k  f  ■  ^Z(/,.,)  {'** }  1*0  ]} 

Po  exp 

[  ’7  '■y"^Z(*,.|){']i}lfcof^»*  />''^Z(«,.,){'}}Iao]} 

(25) 


The  primary  hypothesis,  /iq,  and  the  alternative  hypothesis, 
/i,,  are  not  necessarily  the  same  hypotheses  that  were  used 
for  the  Kalman  filter  models  of  the  filters  that  generated 
the  residuals. 


Examining  Eq  (25),  we  note  that  the  numerators  and 
leading  coefficients  are  equal.  Thus  the  equality  will  hold 
if  and  only  if: 

We  did  not  restrict  the  hypothesis  /ij,  so  if  the  equality  of 
Eq  (26)  holds,  we  can  use  this  development  for  any 
alternative  hypothesis.  We  assume  that  the  hypothesis,  /iq, 
can  consist  of  any  of  the  modeling  differences  that  we  are 
investigating.  First,  we  define  the  error  between  the 
Kalman  filter  state  estimate  and  the  true  system  model 
states  as: 

k  x,(t,)  -  (27) 

Now  we  expand  one  of  the  terms  in  Eq  (13),  using  the 
definitions  of  Eq  (5)  for  the  true  system  model,  and  Eqs 
(8),  (17),  and  (27)  to  get; 

r.«,)4z(/,)  -fl.il.(/;)  =  [H,x,{t,)  *  v,(o]-fl’.^.(/;-) 

=  H,<tr*r(<,.,)  -  .  Vr(/,) 

.  [H,B^  -  H,(B,  -  AB,)]u(t,_,) 

=  *,[*,(/,,)  -  i.(<-,)]  ^  *  v,«,) 

.  H,AB,u(.t,_,) 

(28) 


We  take  the  conditional  expectation  of  this  to  find  the 
mean  of  the  residual: 


W,.i) 


{'•.(()} 

{'•.(()}  =  ,>{^»('/-,)}  *  ^,AB,1|(/,.,) 

(29) 


We  substitute  Eq  (28)  and  Eq  (29)  into  Eq  (26)  and  cancel 
terms  to  get: 

«r*r[  G,«.,(t,.,).V,(/.) 

2  I  e/  c,  w,  (<,.,).  V,  (  o 

(30) 


Using  the  definition  in  Eq  (27)  we  get: 

[^r(  )  "‘^* (  )]  " {^r(  )  "'^*(  ^f-i  )} 

=  [  •*r(^/-i)"^j|(^M^  ]  “  ^z(f,.,){‘*r(  Vi  )  (  ^<-1 )} 

=  “  •^y(^/-l)  "  ^Z(f<.,){^r(  )}  ^  ^y(^/-l) 

•^r  (  )  "  ^z(t,,,)  {^r(  ^(-1  )  }  =  ^<-1  )  ■^z(r,.i){**'r(  )  } 
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Therefore 


/..(»■.)  '4(r,)  (32) 

Thus  we  can  perform  the  hypothesis  test  using  a  single 
Kalman  filter  residual,  testing  it  for  multiple  hypotheses, 
and  this  is  equivalent  to  performing  the  hypothesis  test 
using  multiple  residuals,  each  one  tested  for  a  single 
hypothesis. 

3.5  Binary  Hypothesis  Testing 

Now  we  can  apply  the  Neyman-Pearson  hypothesis 
test  to  the  residual  of  a  Kalman  filter.  We  need  an 
estimate  of  the  residual  covariance  for  a  particular 
hypothesis,  which  we  can  precompute,  as  described  in 
Section  3.1,  by  using  a  Kalman  filter  that  uses  the 
hypothesized  system  model.  We  will  use  the  steady  state 
Kalman  filter  estimate  of  the  residual  covariance  matrix, 
thus  the  residual  covariance  will  be  considered  constant. 
Note  that  the  estimate  for  the  residual  covariance  is  not  a 
function  of  the  system  input  matrix,  B,  Thus,  if  we  only 
have  modeling  differences  in  the  system  input  matrix,  so 
only  AB  is  nonzero,  then  the  residual  covariance  matrix 
will  be  identical  for  each  of  the  hypotheses.  We  will 
develop  the  Neyman-Pearson  based  hypothesis  testing 
algorithm  for  the  case  of  AB  ^  0. 

Under  these  assumptions,  we  have  a  Neyman-Pearson 
detector  for  "common  covariances,  uncommon  means"  as 
developed  by  Scharf  [4:  111].  We  will  develop  the 
Neyman-Pearson  detector  in  the  same  manner  as  Scharf 
does,  but  we  will  extend  it  to  a  single-time  sample 
hypothesis  test  using  a  multidimensional  random  variable 
(a  single  time  sample  of  the  residual). 

We  start  with  a  single  time  sample  of  a  Kalman  filter 
residual  and  design  a  binary  test  using  the  Neyman- 
Pearson  Lemma.  We  denote  the  mean  of  the  residual 
given  the  past  measurement  history  and  a  particular 
hypothesis  as 

^2(,, k  =  “.(O 

k  =  «.«,)•  (”> 

Using  Eq  (22),  the  likelihood  ratio  is  a  ratio  of  two  normal 
density  functions,  which  becomes  the  ratio  or  two 
exponential  terms  when  the  leading  p  terms  are  canceled. 
Thus  the  likelihood  ratio  becomes: 

=  exp  ||  [ r (if  A;'  m,  (<,) . m,  r(t,)  -  m,  m,  (r) 

-  r(t,fA^'  U.yA^'  m,  {I.YA,'  m,  (/,)]} . 

(34) 

Note  that  each  term  within  the  exponential  is  a  scalar  and 


we  can  use  the  symmetric  property  of  the  covariance 
matrix  to  get: 

=  m, (<,)’■  (.4;'  f  r(t,)  =  m,(tyA;'  r(t,) 
r(/,f  A;' m, (/,)-{  raXA^-'m,(/^)  f 

‘m,(ty(A;'yr(t,)  =  m,uyA;'r(t,)  (3®) 
Also,  we  can  use  the  natural  log  of  the  likelihood  ratio  in 
place  of  the  likelihood  ratio  for  decision-making  because 
the  natural  logarithm  is  a  monotonic  function.  Therefore 
we  get  the  log  likelihood  ratio: 

L{r(t,))  =  ln{/(r(0)} 

=  w,  ( <,)’■/!;*  r(  )  -  m,  ( yA;'  r(  /, ) 

- 1  ( '”i( y^'  “iC  O  - “«( y^k'  "•c(  t, ) ) 

- 1  (»!,( )-/«,(/,)  ( i«,(  O -'«.(<,) ) 


where 
siO  - 

b(0  =  (37) 

We  call  s{t,)  the  signal  and  b(t,)  the  bias  of  the  log 
likelihood  function. 

Rewriting  the  Neyman-Pearson  Lemma  to  use  the  log 
likelihood  ratio  in  Eq  (36),  we  get: 

Z(r(/,))  >  n  =  ln(r) 

Now  we  only  need  to  compute  the  threshold  r|  in 
order  to  define  the  Neyman-Pearson  hypothesis  test 
algorithm  completely.  We  first  need  to  find  the 
probability  density  function  for  the  test  statistic  L(  r(r, )). 
We  note  from  Eq  (36)  that  L  is  a  linear  function  of  r, 
therefore  L  is  also  normally  distributed  and  we  need  only 
compute  the  mean  and  covariance  to  define  the 
probability  density  function.  We'll  start  by  computing  the 
mean  under  both  the  primary  and  alternate  hypotheses. 
First  we  define: 

d{t.)  =  w,(/.)  -  Wo(0 

-i:(r(0)  =  rf(0"A,’r(0 

Now  we  compute  the  mean  of  the  test  statistic,  given  that 
the  primary  hypothesis  is  in  force: 

{ riO  )}!..=  d{t,yA-  { r{t,) } 

- 1  '(«,(<■)  *"*.(0) 

=  d{t,yA;'  !«.(<,)  -  i  d{t,yA,'  M,(0  -  i 


4>{r(/,) 
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,  { ^  (»•('-))}  k  =  I  (»».(',)-  «.(0 ) 

= -|^>(0  (40) 

where  D(r,. )  will  be  called  the  hypothesis  discrimination 
measure. 

Likewise,  we  compute  the  mean  of  the  test  statistic 
given  that  the  alternative  hypothesis  is  in  force: 

)}!*.=  {'•(0 }  I*. 

=  d(^t,YA;' «,(/,)  - 1  dO,yA,  '  w,((,)  -  j  rf(// 

=  I  -«,(/,)) 

=  =  (41) 

Now  to  compute  the  conditional  variance  of  the  test 
statistic  under  either  hypothesis: 

=  ,{^(1,)' - 2*(0b(0 *b(0»}- .,{.(0} - b(0 f 


Now  use  Eq  (37)  to  get: 

=  d(tJA,'  ,,(r«,)r(0"K-'rf(0 
=  d(t,yA,'A,A,'dit,) 

^du,yA-'du,)-D(t,).  ('•3) 


To  summarize,  in  the  case  of  a  TVC  nozzle  failure  we 
know  that  the  test  statistic  is  normally  distributed  as 
follows: 


h,  ;  i(r(0)  ~  N 


Djt,) 

2 


£>(<,) 


K 


■■  i(r(0)  -  ff 


D(t,) 

2 


0(0 


(44) 


We  substitute  this  into  the  known  functional  form  for  a 
normal  density,  which  can  then  be  used  to  compute  the 
threshold  p  for  a  given  Pp^.  Using  the  definition  given  in 
Eq  (24),  we  get: 


P..  = 


=  l-Yf?) 


(45) 


where 


0(1,) 


8  = 


0(0“ 


y(-«)=  1  -  y(«)- 
Similarly,  we  can  compute  the  P,,: 


(46) 


/ 


(2iiO(0)'“ 
**  1 
/ 


exp 


X 


D  (»,)'" 


=  1-Y 


D(l,) 

n - - 

'  2 

D(t^r 


expi~ 


D{t,) 


dy 


dx 


(47) 


For  most  applications,  the  designer  would  set  PpA  and 
Pd  to  achieve  the  desired  hypothesis  testing  performance, 
and  that  would  dictate  a  unique  test  threshold,  P,  and  a 
desired  hypothesis  discrimination  measure,  D(r, ),  needed 
to  achieve  the  PpA  and  Pd-  However,  this  does  not  give  us 
a  unique  d{t^  needed  to  achieve  the  desired  discrimination 
measure,  even  for  a  given  Let's  assume  that  one  of 
the  hypotheses,  say  Hq,  is  correct,  so  that  =  0.  This 
gives  us  d(t^)  =  which  we  can  use,  along  with  the 

precomputable  A;^  ^  to  get  a  class  of  residual  means  that 
would  achieve  the  desired  discrimination  measure. 


3.6  N-arv  Hypothesis  Testing 

The  algorithm  developed  in  the  previous  section 
performs  a  single  binary  hypothesis  test,  which  can  be 
extended  to  any  N-ary  test  by  using  the  algorithm  against 
several  alternative  hypotheses.  We  simply  define  the 
mean  of  the  residual  given  a  specific  alternative 
hypothesis  as: 

^X(,,,){'-(0}  I..  -  ('•»> 

where  k  denotes  the  specific  alternative  hypothesis,  and 
define  (r(r,))  as  the  test  statistic  and  as  the 

discrimination  measure  for  the  hypothesis.  The 
development  for  each  of  the  alternative  hypotheses  is  the 
same  as  in  the  previous  section,  except  that  we  replace  the 
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subscript  1  with  k  so  that  we  are  testing  hypothesis  0 
against  hypothesis  k. 

Ail  of  the  alternative  hypothesis  tests  are  run  in 
parallel,  so  all  of  the  test  statistics  and  discriniination 
measures  are  computed  in  parallel  (not  sequentially)  with 
those  of  the  other  hypotheses.  Once  the  discrimination 
measures  are  computed  for  each  of  the  alternative 
hypotheses,  we  collect  the  hypotheses  whose 
discrimination  measure  exceeds  the  desired  discrimination 
measure  (which  is  based  on  andPp).  We  compare  the 
computed  test  statistics  for  each  hypothesis  against  the  test 
threshold  and  keep  the  hypotheses  whose  test  statistic 
exceed  the  test  threshold.  We  then  choose  the  most  likely 
hypothesis  by  choosing  the  hypothesis  with  the  largest  test 
statistic. 

IV.  Simulation  Results 

4. 1  Computation  of  Kalman  Filter  Residual 

We  computed  the  residual  mean  and  covariance  using 
the  development  in  previous  research  [1,3]  and  compared 
it  to  the  actual  residual  for  various  failure  hypotheses.  A 
representative  sample  of  these  comparisons  are  shown  in 
Figures  5,  6,  and  7  where  the  actual  residual  is  plotted 
against  the  computed  mean  of  the  residual  along  with 
dashed  lines  that  show  one  standard  deviation  above  and 
below  the  computed  mean.  Thus,  we  would  expect  the 
68%  of  the  actual  residual  samples  would  fall  within  the 
dashed  lines.  We  show  the  case  where  there  is  no  failure, 
Figure  5,  the  case  where  nozzle  1  is  stuck  closed,  Figure 
6,  and  the  case  where  nozzle  1  is  stuck  open.  Figure  7. 
Note  that  in  all  these  cases  the  actual  residual  matches  the 
computed  mean  and  covariance,  thus  verifying  our 
development  of  the  expected  residual  mean  and 
covariance. 


Figure  5.  Computed  and  Actual  Kalman  Filter  Residual 
for  the  case  of  no  TVC  Nozzle  Failure. 
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Figure  6.  Computed  and  Actual  Kalman  Filter  Residual 
for  the  case  of  a  TVC  Nozzle  Failed  to  Off. 


Figure  7.  Computed  and  Actual  Kalman  Filter  Residual 
for  the  case  of  a  TVC  Nozzle  Failed  to  On. 


4.2  Failure  Identification  Performance 

Using  the  development  in  Section  3,  we  implemented 
a  Neyman-Pearson  Hypothesis  Testing  Algorithm 
(NPHTA),  shown  in  Figure  2.  The  output  of  this 
algorithm  is  a  declaration  of  the  failure  status,  not  a  set  of 
conditional  probabilities.  We  chose  to  compare  the 
declared  failure  status  to  the  true  failure  status  to  evaluate 
the  performance  of  this  algorithm.  In  Figure  8  we  present 
the  failure  identification  performance  of  this  structure,  by 
plotting  the  agreement  (denoted  by  1)  and  disagreement 
(denoted  by  0)  of  the  declared  failure  status  with  the  true 
failure  status.  The  nozzle  "off  failure  were  induced  at 
0.1  seconds  into  the  simulation  of  the  nozzle  "on"  failures 
occur  at  0.16  seconds.  These  results  were  obtained  using 
the  full  9-state  Kalman  filter  models.of  the  nozzle  "on" 
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Figure  8.  Failure  Identification  Performance  of  the 
Neyman-Pearson  Hypothesis  Test  MMAE  Using 
9-State  Kalman  Filter  Models. 


failures  occur  at  0.16  seconds.  These  results  were 
obtained  using  the  full  9-state  Kalman  filter  models. 

The  design  parameters  for  the  NPHTA  are  the 
probability  of  detection  and  probability  of  false  alarm, 
which  were  0,999  and  0.01  respectively,  for  this  research. 
Performance  sensitivity  to  the  choice  of  these  two 
parameters  could  be  investigated  for  a  given  applicatio.., 
but  these  are  chosen  as  reasonable,  representative  values. 

We  experimented  with  reducing  the  computational 
cost  of  implementing  the  NPHTA  MMAE  by  using  3-state 
Kalman  filter  models  instead  of  the  full  9-state  models. 
We  used  only  the  angular  rate  states  (pitch  rate,  roll  rate, 
and  yaw  rate),  thus  the  complete  missile  dynamics  were 
not  accurately  represented.  The  results.  Figure  9,  were 
quite  good.  The  NPHTA  MMAE  identified  the  "off 
nozzle  failures  quickly,  but  eventually  the  inaccurate 
modeling  caused  the  failure  state  to  be  misidentified  at 
about  0.35  seconds  into  the  simulation.  Also,  some  of  the 
stuck  "on"  nozzle  failures  show  some  brief  difficulty  in 
sorting  out  which  failure  status  is  correct,  but  eventually 
correctly  identify  the  failure  status.  These  results  were 
fairly  good  because 
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Figure  9.  Failure  Identification  Performance  of  the 
Neyman-Pearson  Hypothesis  Test  MMAE  Using 
3-State  Kalman  Filter  Models. 


the  nozzle  failures  produced  such  dramatic  changes  in  the 
missile  flight  path  that  the  differences  between  the  various 
failure  hypotheses  were  quite  dramatic,  therefore,  the 
NPHTA  could  distinguish  between  these  various 
hypotheses. 

V.  Conclusions 

A  Nf-yman-Pearson  Hypothesis  Testing  Algorithm 
(NPHTA)  has  been  developed  in  Section  3.  We 
extended  the  standard  development  for  a  scalar  process, 
to  a  multidimensional  process.  We  also  showed  that,  by 
using  the  NPHTA,  we  could  perform  multiple 
hypothesis  tests  on  a  single  Kalman  filter  residual, 
instead  of  having  to  form  a  residual  (and  separate 
Kalman  filter)  for  each  hypothesis.  Thus,  we  would  use 
a  Kalman  filter  "bank"  of  a  single  Kalman  filter, 
followed  by  the  NPHTA.  This  structure  was 
implemented  and  tested,  and  the  results  were  presented 
in  Section  4. 

The  NPHTA  MMAE  structure  provides  a  more 
rigorous  framework  for  attaining  the  desired  failure 
identification  performance.  The  MMAE  designer 
specifies  the  desired  P^  and  PpA^  which  gives  the 
required  discrimination  measure.  With  this  measure 
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specified,  the  MMAE  designer  would  iterate  on  the 
design  of  the  input  dither  until  the  required 
discrimination  measure  is  attained  within  the  desired 
identification  time.  This  alleviates  the  need  to  perform 
extensive  Monte  Carlo  testing  that  is  required  to 
estimate  the  and  PpA  of  the  standard  MMAE 
structure.  Therefore,  we  have  shown  the  initial 
feasibility  of  using  the  NPHTA  MMAE  concept  to 
detect  thrust  vector  nozzle  valve  failures  during  the 
initial  separation  flyout  of  an  advance  air  superiority 
missle. 
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